Reality monitoring and metacognitive judgments in a false-memory paradigm.

How well do we distinguish between different memory sources when the information from imagination and perception is similar? And how do metacognitive (confidence) judgments differ across different sources of experiences? To study these questions, we developed a reality monitoring task using semantically related words from the Deese-Roediger-McDermott (DRM) paradigm of false memories. In an orientation phase, participants either perceived word pairs or had to voluntarily imagine the second word of a word pair. In a test phase, participants viewed words and had to judge whether the paired word was previously perceived, imagined, or new. Results revealed an interaction between memory source and judgment type on both response rates and confidence judgments: reality monitoring was better for new and perceived (compared to imagined) sources, and participants often incorrectly reported imagined experiences to be perceived. Individuals exhibited similar confidence between correct imagined source judgments and incorrect imagined sources reported to be perceived. Modeling results indicated that the observed judgments were likely due to an externalizing bias (i.e., a bias to judge the memory source as perceived). Additionally, we found that overall metacognitive ability was best in the perceived source. Together, these results reveal a source-dependent effect on response rates and confidence ratings, and provide evidence that observers are surprisingly prone to externalizing biases when monitoring their own memories.

Metacognitive awareness in the sound-induced flash illusion.

Hundreds (if not thousands) of multisensory studies provide evidence that the human brain can integrate temporally and spatially discrepant stimuli from distinct modalities into a singular event. This process of multisensory integration is usually portrayed in the scientific literature as contributing to our integrated, coherent perceptual reality. However, missing from this account is an answer to a simple question: how do confidence judgements compare between multisensory information that is integrated across multiple sources, and multisensory information that comes from a single, congruent source in the environment? In this paper, we use the sound-induced flash illusion to investigate if confidence judgements are similar across multisensory conditions when the numbers of auditory and visual events are the same, and the numbers of auditory and visual events are different. Results showed that congruent audiovisual stimuli produced higher confidence than incongruent audiovisual stimuli, even when the perceptual report was matched across the two conditions. Integrating these behavioural findings with recent neuroimaging and theoretical work, we discuss the role that prefrontal cortex may play in metacognition, multisensory causal inference and sensory source monitoring in general. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Common computations in automatic cue combination and metacognitive confidence reports.

Appropriate perceptual decision making necessitates the accurate estimation and use of sensory uncertainty. Such estimation has been studied in the context of both low-level multisensory cue combination and metacognitive estimation of confidence, but it remains unclear whether the same computations underlie both sets of uncertainty estimation. We created visual stimuli with low vs. high overall motion energy, such that the high-energy stimuli led to higher confidence but lower accuracy in a visual-only task. Importantly, we tested the impact of the low- and high-energy visual stimuli on auditory motion perception in a separate task. Despite being irrelevant to the auditory task, both visual stimuli impacted auditory judgments presumably via automatic low-level mechanisms. Critically, we found that the high-energy visual stimuli influenced the auditory judgments more strongly than the low-energy visual stimuli. This effect was in line with the confidence but contrary to the accuracy differences between the high- and low-energy stimuli in the visual-only task. These effects were captured by a simple computational model that assumes common computational principles underlying both confidence reports and multisensory cue combination. Our results reveal a deep link between automatic sensory processing and metacognitive confidence reports, and suggest that vastly different stages of perceptual decision making rely on common computational principles.

Metacognition and Causal Inference in Audiovisual Speech.

In multisensory environments, our brains perform causal inference to estimate which sources produce specific sensory signals. Decades of research have revealed the dynamics which underlie this process of causal inference for multisensory (audiovisual) signals, including how temporal, spatial, and semantic relationships between stimuli influence the brain's decision about whether to integrate or segregate. However, presently, very little is known about the relationship between metacognition and multisensory integration, and the characteristics of perceptual confidence for audiovisual signals. In this investigation, we ask two questions about the relationship between metacognition and multisensory causal inference: are observers' confidence ratings for judgments about Congruent, McGurk, and Rarely Integrated speech similar, or different? And do confidence judgments distinguish between these three scenarios when the perceived syllable is identical? To answer these questions, 92 online participants completed experiments where on each trial, participants reported which syllable they perceived, and rated confidence in their judgment. Results from Experiment 1 showed that confidence ratings were quite similar across Congruent speech, McGurk speech, and Rarely Integrated speech. In Experiment 2, when the perceived syllable for congruent and McGurk videos was matched, confidence scores were higher for congruent stimuli compared to McGurk stimuli. In Experiment 3, when the perceived syllable was matched between McGurk and Rarely Integrated stimuli, confidence judgments were similar between the two conditions. Together, these results provide evidence of the capacities and limitations of metacognition's ability to distinguish between different sources of multisensory information.

Color diversity judgments in peripheral vision: Evidence against "cost-free" representations.

Is visual perception "rich" or "sparse?" One finding supporting the "rich" hypothesis shows that a specific visual summary representation, color diversity, is represented "cost-free" outside focally-attended regions in dual-task paradigms [1]. Here, we investigated whether this "cost-free" phenomenon for color diversity perception extends to peripheral vision. After replicating previous findings and verifying that color diversity is represented "cost-free" in central vision, we performed two experiments: in our first experiment, we extended the paradigm to peripheral vision and found that in minimally-attended regions of space, color diversity perception was impaired. In a second and final experiment, we added confidence judgments to our task, and found that participants maintained high levels of metacognitive awareness of impaired performance in minimally-attended visual areas in the periphery. These findings provide evidence that color perception may be partially attention-dependent in peripheral vision, and challenge previous views on both sides of the rich vs. sparse debate.

Consensus Goals in the Field of Visual Metacognition.

Despite the tangible progress in psychological and cognitive sciences over the last several years, these disciplines still trail other more mature sciences in identifying the most important questions that need to be solved. Reaching such consensus could lead to greater synergy across different laboratories, faster progress, and increased focus on solving important problems rather than pursuing isolated, niche efforts. Here, 26 researchers from the field of visual metacognition reached consensus on four long-term and two medium-term common goals. We describe the process that we followed, the goals themselves, and our plans for accomplishing these goals. If this effort proves successful within the next few years, such consensus building around common goals could be adopted more widely in psychological science.

Tuned inhibition in perceptual decision-making circuits can explain seemingly suboptimal confidence behavior.

Current dominant views hold that perceptual confidence reflects the probability that a decision is correct. Although these views have enjoyed some empirical support, recent behavioral results indicate that confidence and the probability of being correct can be dissociated. An alternative hypothesis suggests that confidence instead reflects the magnitude of evidence in favor of a decision while being relatively insensitive to the evidence opposing the decision. We considered how this alternative hypothesis might be biologically instantiated by developing a simple neural network model incorporating a known property of sensory neurons: tuned inhibition. The key idea of the model is that the level of inhibition that each accumulator unit receives from units with the opposite tuning preference, i.e. its inhibition 'tuning', dictates its contribution to perceptual decisions versus confidence judgments, such that units with higher tuned inhibition (computing relative evidence for different perceptual interpretations) determine perceptual discrimination decisions, and units with lower tuned inhibition (computing absolute evidence) determine confidence. We demonstrate that this biologically plausible model can account for several counterintuitive findings reported in the literature where confidence and decision accuracy dissociate. By comparing model fits, we further demonstrate that a full complement of behavioral data across several previously published experimental results-including accuracy, reaction time, mean confidence, and metacognitive sensitivity-is best accounted for when confidence is computed from units without, rather than units with, tuned inhibition. Finally, we discuss predictions of our results and model for future neurobiological studies. These findings suggest that the brain has developed and implements this alternative, heuristic theory of perceptual confidence computation by relying on the diversity of neural resources available.

An investigation of how relative precision of target encoding influences metacognitive performance.

Detection failures in perceptual tasks can result from different causes: sometimes we may fail to see something because perceptual information is noisy or degraded, and sometimes we may fail to see something due to the limited capacity of attention. Previous work indicates that metacognitive capacities for detection failures may differ depending on the specific stimulus visibility manipulation employed. In this investigation, we measured metacognition while matching performance in two visibility manipulations: phase-scrambling and the attentional blink. As in previous work, metacognitive asymmetries emerged: despite matched type 1 performance, metacognitive ability (measured by area under the ROC curve) for reporting stimulus absence was higher in the attentional blink condition, which was mainly driven by metacognitive ability in correct rejection trials. We performed Signal Detection Theoretic (SDT) modeling of the results, showing that differences in metacognition under equal type I performance can be explained when the variance of the signal and noise distributions are unequal. Specifically, the present study suggests that phase scrambling signal trials have a wider distribution (more variability) than attentional blink signal trials, leading to a larger area under the ROC curve for attentional blink trials where subjects reported stimulus absence. These results provide a theoretical basis for the origin of metacognitive differences on trials where subjects report stimulus absence, and may also explain previous findings where the absence of evidence during detection tasks results in lower metacognitive performance when compared to categorization.

Defending subjective inflation: an inference to the best explanation.

In a recent opinion piece, Abid (2019) criticizes the hypothesis that subjective inflation may partly account for apparent phenomenological richness across the visual field and outside the focus of attention. In response, we address three main issues. First, we maintain that inflation should be interpreted as an intraperceptual-and not post-perceptual-phenomenon. Second, we describe how inflation may differ from filling-in. Finally, we contend that, in general, there is sufficient evidence to tip the scales toward intraperceptual interpretations of visibility and confidence judgments.

Subjective inflation: phenomenology's get-rich-quick scheme.

How do we explain the seemingly rich nature of visual phenomenology while accounting for impoverished perception in the periphery? This apparent mismatch has led some to posit that rich phenomenological content overflows cognitive access, whereas others hold that phenomenology is in fact sparse and constrained by cognitive access. Here, we review the Rich versus Sparse debate as it relates to a phenomenon called subjective inflation, wherein minimally attended or peripheral visual perception tends to be subjectively evaluated as more reliable than attended or foveal perception when objective performance is matched. We argue that subjective inflation can account for rich phenomenology without invoking phenomenological overflow. On this view, visual phenomenology is constrained by cognitive access, but seemingly inflated above what would be predicted based on sparse sensory content.

Prior expectation of objects in space is dependent on the direction of gaze.

Many studies of multisensory spatial localization have shown that observers' responses are well-characterized by Bayesian inference, as localization judgments are influenced not only by the reliability of sensory encoding, but expectations about where things occur in space. Here, we investigate the frame of reference for the prior expectation of objects in space. Using an audiovisual localization task, we systematically manipulate fixation position and evaluate whether this prior is encoded in an eye-centered, head-centered, or hybrid frame of reference. Results show that in a majority of participants, this prior is encoded in an eye-centered frame of reference.

Inflation versus filling-in: why we feel we see more than we actually do in peripheral vision.

Do we perceive fine details in the visual periphery? Here, we propose that phenomenology in the visual periphery can be characterized by an inflated sense of perceptual capacity, as observers overestimate the quality of their perceptual inputs. Distinct from the well-known perceptual phenomenon of 'filling-in' where perceptual content is generated or completed endogenously, inflation can be characterized by incorrect introspection at the subjective level. The perceptual content itself may be absent or weak (i.e. not necessarily filled-in), and yet such content is mistakenly regarded by the system as rich. Behaviourally, this can be reflected by metacognitive deficits in the degree to which confidence judgements track task accuracy, and decisional biases for observers to think particular items are present, even when they are not. In two experiments using paradigms that exploit unique attributes of peripheral vision (crowding and summary statistics), we provide evidence that both types of deficits are present in peripheral vision, as observers' reports are marked by overconfidence in discrimination judgements and high numbers of false alarms in detection judgements. We discuss potential mechanisms that may be the cause of inflation and propose future experiments to further explore this unique sensory phenomenon.This article is part of the theme issue 'Perceptual consciousness and cognitive access'.

Neuroscience: The Key to Consciousness May Not Be under the Streetlight.

Key theories of consciousness predict that the prefrontal cortex (PFC) plays important roles, but there has been relatively little causal evidence showing that manipulation of activity in the region can broadly affect conscious experiences. A new study provides crucial findings to help resolve this issue, showing that direct pharmacological stimulation of PFC restores wakefulness in anesthetized rats.

An investigation of detection biases in the unattended periphery during simulated driving.

While people often think they veridically perceive much of the visual surround, recent findings indicate that when asked to detect targets such as gratings embedded in visual noise, observers make more false alarms in the unattended periphery. Do these results from psychophysics studies generalize to more ecologically valid settings? We used a modern game engine to create a simulated driving environment where participants (as drivers) had to make judgments about the colors of pedestrians' clothing in the periphery. Confirming our hypothesis based on previous psychophysics studies, we found that subjects showed liberal biases for unattended locations when detecting specific colors of pedestrians' clothing. A second experiment showed that this finding was not simply due to a confirmation bias in decision-making when subjects were uncertain. Together, these results support the idea that in everyday visual experience, there is subjective inflation of experienced detail in the periphery, which may happen at the decisional level.

Superior colliculus neuronal ensemble activity signals optimal rather than subjective confidence.

Recent studies suggest that neurons in sensorimotor circuits involved in perceptual decision-making also play a role in decision confidence. In these studies, confidence is often considered to be an optimal readout of the probability that a decision is correct. However, the information leading to decision accuracy and the report of confidence often covaried, leaving open the possibility that there are actually two dissociable signal types in the brain: signals that correlate with decision accuracy (optimal confidence) and signals that correlate with subjects' behavioral reports of confidence (subjective confidence). We recorded neuronal activity from a sensorimotor decision area, the superior colliculus (SC) of monkeys, while they performed two different tasks. In our first task, decision accuracy and confidence covaried, as in previous studies. In our second task, we implemented a motion discrimination task with stimuli that were matched for decision accuracy but produced different levels of confidence, as reflected by behavioral reports. We used a multivariate decoder to predict monkeys' choices from neuronal population activity. As in previous studies on perceptual decision-making mechanisms, we found that neuronal decoding performance increased as decision accuracy increased. However, when decision accuracy was matched, performance of the decoder was similar between high and low subjective confidence conditions. These results show that the SC likely signals optimal decision confidence similar to previously reported cortical mechanisms, but is unlikely to play a critical role in subjective confidence. The results also motivate future investigations to determine where in the brain signals related to subjective confidence reside.

Should a Few Null Findings Falsify Prefrontal Theories of Conscious Perception?

Is activity in prefrontal cortex (PFC) critical for conscious perception? Major theories of consciousness make distinct predictions about the role of PFC, providing an opportunity to arbitrate between these views empirically. Here we address three common misconceptions: (1) PFC lesions do not affect subjective perception; (2) PFC activity does not reflect specific perceptual content; and (3) PFC involvement in studies of perceptual awareness is solely driven by the need to make reports required by the experimental tasks rather than subjective experience per se. These claims are incompatible with empirical findings, unless one focuses only on studies using methods with limited sensitivity. The literature highlights PFC's essential role in enabling the subjective experience in perception, contra the objective capacity to perform visual tasks; conflating the two can also be a source of confusion.Dual Perspectives Companion Paper: Are the Neural Correlates of Consciousness in the Front or in the Back of the Cerebral Cortex? Clinical and Neuroimaging Evidence, by Melanie Boly, Marcello Massimini, Naotsugu Tsuchiya, Bradley R. Postle, Christof Koch, and Giulio Tononi.

A simple and efficient method to enhance audiovisual binding tendencies.

Individuals vary in their tendency to bind signals from multiple senses. For the same set of sights and sounds, one individual may frequently integrate multisensory signals and experience a unified percept, whereas another individual may rarely bind them and often experience two distinct sensations. Thus, while this binding/integration tendency is specific to each individual, it is not clear how plastic this tendency is in adulthood, and how sensory experiences may cause it to change. Here, we conducted an exploratory investigation which provides evidence that (1) the brain's tendency to bind in spatial perception is plastic, (2) that it can change following brief exposure to simple audiovisual stimuli, and (3) that exposure to temporally synchronous, spatially discrepant stimuli provides the most effective method to modify it. These results can inform current theories about how the brain updates its internal model of the surrounding sensory world, as well as future investigations seeking to increase integration tendencies.

Limited Cognitive Resources Explain a Trade-Off between Perceptual and Metacognitive Vigilance.

Why do experimenters give subjects short breaks in long behavioral experiments? Whereas previous studies suggest it is difficult to maintain attention and vigilance over long periods of time, it is unclear precisely what mechanisms benefit from rest after short experimental blocks. Here, we evaluate decline in both perceptual performance and metacognitive sensitivity (i.e., how well confidence ratings track perceptual decision accuracy) over time and investigate whether characteristics of prefrontal cortical areas correlate with these measures. Whereas a single-process signal detection model predicts that these two forms of fatigue should be strongly positively correlated, a dual-process model predicts that rates of decline may dissociate. Here, we show that these measures consistently exhibited negative or near-zero correlations, as if engaged in a trade-off relationship, suggesting that different mechanisms contribute to perceptual and metacognitive decisions. Despite this dissociation, the two mechanisms likely depend on common resources, which could explain their trade-off relationship. Based on structural MRI brain images of individual human subjects, we assessed gray matter volume in the frontal polar area, a region that has been linked to visual metacognition. Variability of frontal polar volume correlated with individual differences in behavior, indicating the region may play a role in supplying common resources for both perceptual and metacognitive vigilance. Additional experiments revealed that reduced metacognitive demand led to superior perceptual vigilance, providing further support for this hypothesis. Overall, results indicate that during breaks between short blocks, it is the higher-level perceptual decision mechanisms, rather than lower-level sensory machinery, that benefit most from rest. SIGNIFICANCE STATEMENT: Perceptual task performance declines over time (the so-called vigilance decrement), but the relationship between vigilance in perception and metacognition has not yet been explored in depth. Here, we show that patterns in perceptual and metacognitive vigilance do not follow the pattern predicted by a previously suggested single-process model of perceptual and metacognitive decision making. We account for these findings by showing that regions of anterior prefrontal cortex (aPFC) previously associated with visual metacognition are also associated with perceptual vigilance. We also show that relieving metacognitive task demand improves perceptual vigilance, suggesting that aPFC may house a limited cognitive resource that contributes to both metacognition and perceptual vigilance. These findings advance our understanding of the mechanisms and dynamics of perceptual metacognition.

What Type of Awareness Does Binocular Rivalry Assess?

Recent experiments demonstrate that invisible stimulus features can induce binocular rivalry, indicating the phenomenon may be caused by differences in perceptual signal strength rather than conscious selection processes. Here, we clarify binocular rivalry's role in consciousness research by highlighting a critical difference between two distinct types of visual awareness.